DeepAVO: Efficient pose refining with feature distilling for deep Visual Odometry

نویسندگان

چکیده

The technology for Visual Odometry (VO) that estimates the position and orientation of moving object through analyzing image sequences captured by on-board cameras, has been well investigated with rising interest in autonomous driving. This paper studies monocular VO from perspective Deep Learning (DL). Unlike most current learning-based methods, our approach, called DeepAVO, is established on intuition features contribute discriminately to different motion patterns. Specifically, we present a novel four-branch network learn rotation translation leveraging Convolutional Neural Networks (CNNs) focus quadrants optical flow input. To enhance ability feature selection, further introduce an effective channel-spatial attention mechanism force each branch explicitly distill related information specific Frame (F2F) estimation. Experiments various datasets involving outdoor driving indoor walking scenarios show proposed DeepAVO outperforms state-of-the-art methods large margin, demonstrating competitive performance stereo algorithm verifying promising potential generalization.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Selecting Feature Detectors for Accurate Visual Odometry

This work analyzes the performances of different feature detectors/descriptors in the context of incremental path estimation from passive stereo vision (Visual Odometry). Several state-of-the-art approaches have been tested, including a fast Hessian-based feature detector/descriptor developed at INRIM. Tests on both synthetic image sequences and real data show that in this particular applicatio...

متن کامل

Robust Stereo Feature Descriptor for Visual Odometry

In this paper, we propose a simple way to utilize stereo camera data to improve feature descriptors. Computer vision algorithms that use a stereo camera require some calculations of 3D information. We leverage this pre-calculated information to improve feature descriptor algorithms. We use the 3D feature information to estimate the scale of each feature. This way, each feature descriptor will b...

متن کامل

Binary Feature Based Localization for Visual Odometry

Recently, Google, Microsoft and several start-ups have started to launch services for indoor maps. Due to its potentially high localization accuracy and its independence from hardware installations, visual indoor localization and navigation for hand-held devices is becoming a hot topic. A visual localization system consists of a visual odometry system with an integrated relocalization algorithm...

متن کامل

Evaluating Pose Estimation Methods for Stereo Visual Odometry on Robots

Structure-From-Motion (SFM) methods, using stereo data, are among the best performing algorithms for motion estimation from video imagery, or visual odometry. Critical to the success of SFM methods is the quality of the initial pose estimation algorithm from feature correspondences. In this work, we evaluate the performance of pose estimation algorithms commonly used in SFM visual odometry. We ...

متن کامل

Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstruction

Despite learning based methods showing promising results in single view depth estimation and visual odometry, most existing approaches treat the tasks in a supervised manner. Recent approaches to single view depth estimation explore the possibility of learning without full supervision via minimizing photometric error. In this paper, we explore the use of stereo sequences for learning depth and ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2022

ISSN: ['0925-2312', '1872-8286']

DOI: https://doi.org/10.1016/j.neucom.2021.09.029